AUTOMATED SCORING OF INTEGRATIVE COMPLEXITY USING MACHINE LEARNING AND NATURAL LANGUAGE PROCESSING by AARDRA

نویسندگان

  • KANNAN AMBILI
  • Khaled Rasheed
  • Aardra Kannan Ambili
  • Walter D. Potter
  • Adam Goodie
  • Julie Coffield
چکیده

Conceptual/Integrative complexity is a construct developed in political psychology and clinical psychology to measure an individual’s ability to consider different perspectives on a particular issue and reach a justifiable conclusion after consideration of said perspectives. Integrative complexity (IC) is usually determined from text through manual scoring, which is timeconsuming, laborious and expensive. Consequently, there is a demand for automating the scoring, which could significantly reduce the time, expense and cognitive resources spent in the process. Any algorithm that could achieve the above with a reasonable accuracy could assist in the development of intervention systems for reducing the potential for aggression, systems for recruitment processes and even training personnel for improving group complexity in the corporate world. The proposed approach produced classification accuracies ranging from 75% to 83%, which is a first in the literature for automated scoring of integrative complexity. INDEX WORDS: integrative complexity, text classification, semantic similarity, support vector machines AUTOMATED SCORING OF INTEGRATIVE COMPLEXITY USING MACHINE LEARNING AND NATURAL LANGUAGE PROCESSING

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Automated Scoring Tool for Korean Short-Answer Questions Based on Semi-Supervised Learning

Scoring short-answer questions has disadvantages that may take long time to grade and may be an issue on consistency in scoring. To alleviate the disadvantages, automated scoring systems are widely used in America or Europe, but, in Korea, there has been researches regarding the automated scoring. In this paper, we propose an automated scoring tool for Korean short-answer questions using a semi...

متن کامل

The Impact of Training Data on Automated Short Answer Scoring Performance

Automatic evaluation of written responses to content-focused assessment items (automated short answer scoring) is a challenging educational application of natural language processing. It is often addressed using supervised machine learning by estimating models to predict human scores from detailed linguistic features such as word n-grams. However, training data (i.e., human-scored responses) ca...

متن کامل

Presentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures

Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...

متن کامل

Presentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures

Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...

متن کامل

CriterionSM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays

This paper describes a deployed educational technology application: the Criterion Online Essay Evaluation Service, a web-based system that provides automated scoring and evaluation of student essays. Criterion has two complementary applications: E-rater, an automated essay scoring system and Critique Writing Analysis Tools , a suite of programs that detect errors in grammar, usage, and mechani...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014